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Abstract: In this paper we calculate the mean number of metastable states for spin 
glasses on so called random thin graphs with couplings taken from a symmetric binary 
distribution ±J. Thin graphs are graphs where the local connectivity of each site 
is fixed to some value c. As in totally connected mean field models we find that the 
number of metastable states increases exponentially with the system size. Furthermore 
we find that the average number of metastable states decreases as c in agreement with 
previous studies showing that finite connectivity corrections of order 1/c increase the 
number of metastable states with respect to the totally connected mean field limit. We 
also prove that the average number of metastable states in the limit c — > oo is finite and 
converges to the average number of metastable states in the Sherrington-Kirkpatrick 
model. An annealed calculation for the number of metastable states Nms(E) of energy 
E is also carried out giving a lower bound on the ground state energy of these spin 
glasses. For small c one may obtain analytic expressions for (N MS (E)). 
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1 Introduction 



The nature of the spin glass phase in finite dimensions is still, after more than twenty 
years of study, a widely contested area of condensed matter physics [|T|. One one hand 
the droplet or scaling picture 0, [| suggests that finite dimensional spin glasses may be 
described by a two phase picture as in a ferromagnet and on the other hand mean field 
calculations on spin glass models suggest that there are an exponentially large number 
of pure states organised in an ultrametric geometry coming from the Parisi scheme of 
replica symmetry breaking Q . If the latter point of view is correct one should certainly 
see at zero temperature a large number of metastable states, reflecting the complexity of 
the free energy landscape (however the reader is referred to the interesting discussion of 
the relevance of metastable states to pure states in ||). There has been a considerable 
amount of effort to analyse the metastable states in the Sherrington-Kirkpatrick mean 
field model || [7|, [| |10j, [llj] and also the number of solutions of the TAP mean field 
equations for this model (the generalisation of metastable states to finite temperature) 
12|, [13|]. Calculations on this model demonstrate the existence of an exponentially large 



(in terms of the number of spins N) number of metastable states and the continuing 
existence of a macroscopic entropy of metastable states even at arbitrarily high vales 
of a uniform magnetic field (in agreement with the divergence of the Almeida Thouless 
line at zero temperature) |TJ]]. This latter fact is clearly a pathology of the totally 
connected geometry of the SK model. In the SK model each spin is connected to all 
the other spins and the existence of the thermodynamic limit is ensured by scaling the 
couplings by a factor 1/y/N in the case of symmetric distributions. This scaling of 
the interaction strength with the system size is clearly undesirable when one wishes to 
make a connection with the finite dimensional analogue, the Edwards Anderson model, 
and as remarked earlier the survival of the Parisi scheme of replica symmetry breaking 
to finite dimensional systems is still hotly debated. Corrections to order 1/c about 
mean field theory || seem to suggest an enhancement of the number of metastable 
states when the dimension is reduced - at odds with the naive intuition that increasing 
the connectivity should increase the complexity of the system and hence give rise to 
more local minima in the energy landscape. 

In this paper we present the calculation of the average number of metastable states 
for spin glasses on thin graphs, these models have been extensively studied in |y| 
and whilst accessible to mean field treatment each spin interacts with a fixed number 
(denoted here by c) of other spins. It is clear that in these models a sufficiently large 
external field will impose the existence of a single metastable at zero temperature. In 
this case the nature of the distribution of the interactions may be expected to play 
a role, in the Sherrington-Kirkpatrick model the nature of the interactions is wiped 
out by the central limit theorem. Another model of finite connectivity but where the 
local connectivity fluctuates is the Viana Bray model, this was the first of these type of 
models to be studied [16|. The drawback with these types of finite connectivity models 
is that the spin glass phase must be characterised by all of the multi-spin overlaps 
possible (in the SK model one can use simply the two spin overlap (a a ab) where a 
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and b are distinct replica indices (see |T7j for a very clear discussion of the replica 



formalism for dilute models). This additional technical difficultly to date has hindered 
the application of a replica symmetry breaking scheme in these models, although it 
has been shown that the replica symmetric solution is neither stable at the transition 
temperature, nor at zero temperature in a number of cases | fL8|j . 

The advantage of a metastable state calculation is that, while it only gives an indication 
of the possible nature of the spin glass phase, one may carry out calculations without 
replicas. 

2 Basic formalism 

The spin glass model we shall consider has the Hamiltonian 

H=--^2J ij n ij 3 i 3 j (1) 

where the Si are Ising spins, is equal to one if the sites i and j are connected and 
the Jij are taken from a binary distribution where = — 1 with probability half and 
Jij = 1 with probability half. The techniques used in this paper can also be used in the 
case of other symmetric probability distributions, such as the Gaussian distribution, 
however the advantage with the binary distribution is that one may find analytical 
expressions for certain quantities that would require numerical solution in the case of 
other distributions. A metastable state is defined to be a configuration where if one 
changes the sign of any given spin the energy does not decrease, for the purposes of 
this paper we shall include the marginal, case where the energy does not change, as 
being metastable. With this definition number of metastable states is given by || |9], || 

N MS = Tr [] ( £ JijmjSiSj ] (2) 

The fact that we include the marginal case implies that here 9{x) the Heaviside step 
function is taken such that 9(0) = 1. One may exploit the parity of the distribution of 
the by making a gauge transformation — > JijSiSj |j, [J to obtain 

(Nms) = 2 N ({[e (^J^A) (3) 
»=i \j# j 

Here we are obliged to discuss the construction of the thin graphs. One may generate 
these graphs by considering planar Feynman diagrams as in ||19|| , however we shall 



construct them by selecting the graphs of fixed local connectivity from a larger ensemble 
of random graphs, that is the type of random graph found in the Viana Bray spin glass 
model fT6| . These random graphs are simply constructed as follows: any two points 
are connected with probability p/N. Hence riy is equal to one with probability p/N 
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and zero with probability 1 — -j^. Here p is some arbitrary number of order one and we 
shall see that the results one obtains are independent of the choice of p. If we denote 
the average on a random graph (with a specified value of p) by {-} p then the induced 
average over the subset of thin graphs of connectivity c is given by 

( v (FI\f=lSj2 ...ny ,c)p , 

(F) = ; ^ / 4 

S 1 M(N,c,p) 1 ; 

where 

N 

M(N,c,p) = (l[S i: >c ) p (5) 
i=i 

is the average number of thin graphs of connectivity c generated by the random graph 
ensemble for a given p. Expressing the Kronecker delta functions as Fourier integrals 
one finds: 

M(N,c,p) = (j^yj J o II c?Ai exp ^iJ2 X i n ij ~ ic J2 X ^j) 

= (2^p Jo n dX * exp(-icA,) J] [l - — + — exp + A,)) J 
= (2^p 7o n dX i exp(-icA,) exp I — — + — £ exp + Aj)) + 0(1) 
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where we have neglected terms of 0(1) in the exponential above. We now carry out a 
Hubbard-Stratonovich transformation yielding 



M(N,c,p) = ^ N+ i J dzexp ~ II ex P (~ icX i +P^exp(iAi)) d\ 

= A J dz exp(NS[z}) (6) 
where A is a constant term containing non-extensive terms in N and 

^2 / fl-K , , x \ p 



S[z] = -^— + \og(^J dAexp ^— icA +p2^exp(iA)^ — log(27r) 
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= — + clog(z) + - log(p) - log(c!) - - (7) 

The integral over z may now be evaluated by the saddle point method at the maximum 
of S given by its value at z* = ca leading to the final result 

log(M(N,c,p)) 1 p 

— = sup = -c (log(c) + log(p) - 1) - log(c!) - - (8) 
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It is worth noting that the value of p maximising the average number of thin graphs of 
connectivity c is p = c as one would expect. 
In the notation set up so far we have that 

D(N,c,p) 

{Nms) ~ M(N,c,p) (9) 

where 

D(N,c,p) = (( (f[0 (E^ J ^. nij , C ) P »j (10) 
i=i / 

where indicates the average over the couplings. Using the representation 

1 roo roo 

0(z) = — dx dX*exp(-iX*(z-x)) (11) 

Z7T JO- J-oo 

we obtain 

D(N,c,p) = (( (^n~2N J Y[d\id\*dxiexp ^—ic E ^ + E %iX* + i ^ n^X 

- i^n ij J ij (X* + A*) (12) 

Carrying out the average over the n^- one obtains 

If ( Np 

D(N, c, p) = m J ]J d\id\*dxi exp I -ic ^ X t + ^ a^A* - — 

j \ i i 

+ £j E((^P (< (A, + A, - J y (A? + A*))))), j (13) 

We emphasise that the disorder average here is an annealed one as one is computing 
{N M s} and not {\og(N MS ))- For the symmetric binary distribution considered here one 
finds 

lr ( Np 

D(N, c, p) = 2Nn2N J II dXidX*dxi exp I -ic^A; + ^ XjA* - — 

+ ^ E ^P (<(Ai + A, - A* - A*)) + ^ £ exp (i(A, + A, + A* + A*)) J (14) 

Making a Hubbard Stratonovich transformation to decouple the two interacting terms 
one obtains one may carry out the A, A* and x integrations site by site to obtain 

N r 

D(N,c,p) = 27r2N7r2N J dz_dz + exp(NS**[z + ,z_]) (15) 
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where 



S**[z+,z. 



P 



+ log 



d\d\*dx exp 



z + exp + A*)) + (|)**- exp - A*)) - icA + i\*x\ 



(16) 



Recalling that the A integration is on (0, 2tt), the A* integration is on (—00,00) and 
the x integration is on [0~,oo) (because we have chosen to take #(0) = 1) one may 
simplify, after some algebra, the integral in the logarithm in ([16]) to obtain 



S~[z+,z_ 



y - f + I (log(p) - log(2)) + 2 log(27r) + log 



E 



ml c — m) 



(17) 

The remaining integrals may be evaluated by the saddle point method, collecting the 
extensive terms in N and normalising by the term M(N, c,p) we find the result 



lQg((iVMs)) 

N 



sup S* [z + , z_ 

{z+,z_} 



;is) 



where 

S*[z + ,z. 



1 2 1 2 , 



E 



m! c — m ! 



+ log(2)(l-|) + ic(l-log(c)) (19) 



where we see that the dependence on p has disappeared (this is normal as the intro- 
duction of p was as a mathematical artifact to construct the thin graphs). Making the 
change of variables z~ = p>z + in equation (|19|) one may solve the saddle point equation 
explicitly for z + and one finds that 



\og((N M3 )) 
N 



sup S [fj] 



where 



s\iA 



^clog(l + /i 2 ) + log(2)(l-|) + log 



E 



m\(c — m)\ 



(20) 
(21) 



3 Specific examples 

The case c = 1 can be easily solved, one finds that 

!«) = i log(2) (22) 

This result is easy to understand as the spins form dimers, each dimer has two possible 
states corresponding to a change in the sign of each of the two spins concerned. 
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The case c = 2 is of interest as when c = 2 the thin graphs correspond to a collection 
of large closed chains of spins. Here we find that 



!25^). log( i±V5) (23) 

The number of metastable states in one dimensional spin glasses has been studied in 
the case of a continuous even probability distribution p(J) for the Jjj by Derrida and 
Gardner [20| and by Li []21j] . In this case one finds the results log ^^ MS ^ = log(^) and 



(log(A^Ms)) _ i g(2)/3, that is these two averages are independent of the precise form 
of p(J). In the case of the binary distribution studied here one may carry out the 



following extremely easy calculation | 21| . Using the notation developed earlier one 
may write in one dimension 

N 

{N MS ) = 2 N (l[6 (J t _ lti + J M+1 ))) (24) 

i=l 

Define by Q + (N)/Q~(N) the average number of metastable states of a one dimensional 
spin glass with N bonds where the last (iVth) bond is taken to be positive /negative. 
The boundary conditions at the end of the chains are taken to be free but this does 
not change the result in the thermodynamic limit. By recurrence it is easy to see that 



Q+(N) = ig+(AT-l) + Ig-(iV-l) (25) 
Q-(N) = ±Q+(N-1) (26) 



Solving these equations we find in the thermodynamic limit the result (|23|). Of course 
this result is not surprising as it is clear that the thin graphs generated in the case c = 2 
will generate a number of disconnected loops of macroscopic size, the additivity of the 
entropy of the metastable states ensures the equivalence of the two results. What is 
amusing however is that a mean field calculation is capable of reproducing a transfer 
matrix calculation for a one dimensional system ! 

In the case c = 3 the saddle point equations remain quadratic and one finds that 

!2«.I log( 2) m 

If one wished to naively mimic a lattice system c = 3 could correspond to a honeycomb 
lattice is two dimensions. This model has been studied numerically by a transfer matrix 
method in and in the case of the binary bond, distribution considered here it was 
found that log((N M g))/(N log(2)) = 0.339 compared to the prediction of (|27D which 
gives 0.33903, leading to the intriguing question whether ( |2"TD is an exact result. Even 
if not an exact result, the random graph approximation for the honeycomb lattice 
problem provides a remarkably accurate result, suggesting that many of the properties 
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of finite dimensional lattice spin glasses are dominated by the geometry of their local 
connectedness and not by their global topology. 

For values of c > 4 one may solve the equations numerically and the results are show 
in figure (1). Note that the higher of the two curves shown corresponds to even values 
of c where (Nms) can be expected to be large as we have included as metastable 
states those whose energy is unaltered or increased when flipping a single spin (i.e. the 
marginally metastable states. The two curves tend to the same limit 0.28743. This is 
the value obtained in the Sherrington Kirkpatrick model by Tanaka and Edwards ||. 
However the approach to the two limits is different. In the case of c odd the correction 
is as 1/c as in the case of the SK model, in this case there are no marginal metastable 
state and in the SK model there are almost surely no marginal metastable states. In 
the case c even however there are marginal metastable states and the correction to the 
totally connected states is found to be numerically l/ca. Here we will demonstrate 
analytically the convergence to the SK result. 
We may rewrite the action S\jj] as 

S[fi] = -iclog(l + + log(2)(l - |) + +clog(l + n) + log [F(jjl)] (28) 

where 

F(ji) = V Z q „ (29) 
^ f m!(c-m)! 

where p = and q = 1 — p may be interpreted as the probability of success and 
failure of a Bernoulli process. Using the central limit theorem one may write in the 
limit of large c that F\pi] — > P(X > |) where X is a Gaussian random variable of 
mean p and variance pq/c (we shall see a postiori that the ansatz on the asymptotic 
behaviour of fi at its saddle point value and the central limit theorem approximation 
are consistent to the same order of approximation). We now make the ansatz that for 
c large the saddle point value of \i has the form /j, = I + a/c^ + lower order terms. 
Using the central limit theorem we find 




(30) 



The ansatz above on fi gives p ~ h H — V giving finally 

4e2 




^i^i-i^iT ) dz (31) 

Making the same ansatz throughout the action and developing to leading order gives 
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S[a] = log(2) - - + log 




cxp 



z ) dz 



(32) 



Which is exactly the same as the variational equation in |3j leading to the result for 
the SK model. 



4 Metastable states of fixed energy 



Here we shall examine the average of the number of metastable states Nms{E) of with 
a given energy E per spin. To exactly calculate the zero temperature thermodynamic 
properties of the system on should calculate the average value of the logarithm of this 
number, which is probably not the log of the average value of N M s(E) due to correla- 
tions between states of the same fixed energy (for example see the discussions in || |J ) . 
from Jensen's inequality however one has the bound (log (Nms(E))) < log ((Nms(E))). 
We may write Nms(E) as 



N 



(33) 



N MS (E) =Trl[5(H-EN)9[Y^ Ji^S^ 
i=i \j& 

The calculation now includes an additional integration to enforce the energy constraint 
which amounts to adding an external uniform field to the fields A*. One finds that 



\og((N MS (E))) 
N 



sup S* [z + , Z-, a] 



(34) 



where a is an additional Lagrange multiplier enforcing the constraint on the energy 
and 



z 2 z 2 _ 

S*[z + ,z_,a] = -- ± — ?T+ lo £ 



c c—m y 'tn — met 



E 



m\(c 



m) 



making the substitution z. 
z + as before to obtain 



where 



+log(2)(l-0+i C (l-log(2))+a 

(35) 

/iz + , one may then solve the stationarity equation for 



hg((N MS (E))) 
N 



sup S [/!, a] 



S \n, a] = -iclog(l + n 2 ) + log(2)(l - |) + log 



E 



c\fi m e- am 
m\(c — m)\ 



-a[--E 



(36) 



(37) 



For c > 4 the equations maximising (|3"7| ) may now be solved numerically by fixing a 
and maximising over \i. The corresponding value for the energy is then given by 



E= c (l-nl(a) 



2 Vl + ^(a) 



(3? 



where fi*(a) is the value of /i is that which maximises (|3T| ) for fixed a. 

In the cases c = 2 and c = 3 an analytic solution is possible; one finds that for c = 2 

the support of (Nms(E)) is (—1,0) where 

'° g(( y E))) = (l^.o g (l- £ )-(l±^.o g (l +B)+B .o g (2) +£ lo g (- £ ) (39) 
In the case c = 3 the support of (N MS (E)) is (— |, — |) where 

log((iWiS))) = _ log(2) -(3^)log(3 + 2E) + ^log(3-2E) 

+£ log(3) + log(-l - 2E) (40) 

Hence of the advantages of this model is that one can have exact analytical expressions 
for the density of metastable states in terms of energy (in totally connected mean field 
models only a numerical solution is possible). 
Defining 

E* = M{E : = 0} (41) 

from Jensen's inequality it is clear that the ground state energy of the system E g is 
bounded from below by E*, i.e. E g > E*. This value of E* is shown in figure (3) for 
values of c up to 30. 



5 Conclusion 

In conclusion we have seen that in agreement with calculations to order 1/c, where c is 
the lattice connectivity for the Edwards Anderson model, about the mean field Edwards 
Anderson model, decreasing the local connectivity increases the average metastable 
states for a spin glass on a thin graph (apart from the fluctuations that occur on go- 
ing between even and odd connectivities). For realistic values of c (i.e. those that 
could mimic three dimensional lattice structures) one finds an exponentially large av- 
erage number of metastable states. Interestingly the calculation for c = 3 appears to 



reproduce the numerical calculation of [22] for the two dimensional honeycomb lattice. 
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Figure 3: Lower bound E* for the groundstate energy E g as a function of connectivity 

c 



